No one actually understands what would happen even for slight re-arrangement of the architecture – changing numbers of “heads”, transformer “full layers” and so on. This is just a modern day Tantra, when everything is based on current socially constructed and largely disconnected from reality set of beliefs.

Another one who knows